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DUPLlpATE 



VIDEO SYNCHRONISATION 
The present invention relates to the video synchronisation. 

It has been proposed to distribute video data over an asynchronous switched network. 
5 The data may be distributed to many receivers which process the data independently of one 
another. Some processes at the receivers require two video streams to be processed 
synchronously, for example a simple cut between two video streams must be accurate to one 
frame boundary. However an asynchronous network does not inherently maintain frame 
synchronisation and different paths taken by the video streams through the network may be 
1 0 subject to different delays. 

A prior proposal, demonstrated at the NAB 2001 conference, distributed video data 
over a network. Timing data linking local clocks to a reference clock was distributed over 
another, separate, network 

ITU-T Rec H222.0 (1995E) discloses that within the ITU-T Rec H222.01 ISO/IEC 
15 13818-1 systems data stream (i.e. MPEG) there are clock reference time stamps called 
System Clock References (SCR). The SCRs are samples of the System Time Clock (STC). 
They have a resolution of one part in 27MHz and occur at intervals of up to 100ms in 
Transport Streams and up to 700ms in Program Streams. Each Program Stream may have a 
different STC. The SCR field indicates the correct value of the STC of an encoder at the time 
20 the SCR is received at a corresponding decoder. With matched encoder and decoder clock 
frequencies, any correct SCR value can be used to set the instantaneous value of the 
decoders STC. This condition is true provided there is no discontinuity of timing for 
example the end of a Program Stream. In practice the free running frequencies of the clocks 
will not be matched. Thus there is a need to slave the clock of the decoder to that of the 
25 encoder using a Phase Locked Loop (PLL).At the moment each SCR arrives at the decoder it 
is compared with the STC of the decoder. The difference (SCR-STC) is an error which is 
applied to a low pass filter and gain stage to generate a control value for the voltage 
controlled oscillator which is the clock of the decoder. 

The system described above uses a synchronous network and locks the absolute time 
30 of the decoder clocks to the reference clock. ' * 

The present invention seeks to provide frame synchronisation of video streams at a 
destination at which the streams are processed, the destinations being linked to sources of the 
video streams by an asynchronous packet switched network without necessarily' requiring 
infrastructure additional to the network. • : ■ 
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reference data processor across the network, clock timing packets each including a field 
containing the destination address of the local processor and a field containing reference 
clock data indicating the time at which the clock timing packet is sent; and controlling the 
frequency of the local clock in dependence on the reference clock data and the times of 
arrival of the clock timing packets. 

Sending timing packets over the network allows the clocks to be synchronised 
without necessarily requiring infrastructure additional to the network. By using, as the 
reference clock data, data which is that current at the time at which the packet is sent 
(launched onto the network) the effect of any processing delay or jitter in the source data 
processor is reduced. For example, a timing packet generator creates a timing packet with an 
empty time data field. At (or just before) the moment at which the packet is launched onto 
the network, the reference time is sampled and the time is put into the time data field. 

These and other aspects of the invention are set out in the claims to which attention is 
directed. 

Embodiments of the invention will now be described with reference to the 
accompanying drawings in which: 

Figure 1 is a schematic block diagram of an illustrative asynchronous switched 
network according to the invention to which are coupled a transmitter which transmits video 
and associated clock data and frame timing data onto the network and a corresponding 
receiver; 

Figure 2 is a schematic timing diagram illustrating the operation of the network of 
Figure 1 in respect of clock timing packets; 

Figure 3 is a schematic diagram illustrating an example of a frame timing packet 
according to the invention; 

Figure 4 is a schematic block diagram of an illustrative frequency locked loop (FLL) 
used in the receiver of Figure 1 ; 

Figure 5 is a schematic block diagram of an illustrative clock difference circuit used 
in the FLL of Figure 4; 

Figure 6 is a schematic block diagram of an illustrative accumulator used in the FLL 
of Figure 4; 

Figure 7 is a schematic diagram illustrating an example of a video packet; 
Figure 8 is a schematic diagram illustrating an example of a frame timing and video 
packet according to the invention; 
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Referring again to Figure 1, the transmitter 2 comprises the source 8 of video packets 
8 and the reference clock 10. The video packets are received by an interface and multiplexer 
16 which supplies the packets to a network interface 15. The network interface 15 sends the 
video packets across the network in conventional manner. A first counter 12 counts the 

5 clock ticks (cycles) of the reference clock. A timing packet generator 14, which operates 
under the control of the interface 16 obtains the reference count of the counter 12 at any time 
when the network has spare capacity to transmit a time packet and places it into the time 
stamp data field (see Figure 3) of a timing packet which is then sent across the network. The 
time stamp data is the time indicated by the reference clock at the time the packet is sent. 

1 0 The timing packets are produced including reference counts and transmitted to a receiver 4 at 
frequent, but varying, intervals. 

The frame sync circuit 1 1 operates synchronously with the clock 1 0 and produces for 
the source 8 a frame sync pulse once per video frame in conventional manner. Referring to 
Figures 1 and 10, a second counter 13 counts reference clock pulses for an interval 8t f and 

15 supplies the count 8t f to the time packet generator 14 which places the count in the frame 
time data field of the packet shown in Figure 3. The interval 5t f begins at the time of 
production of a frame sync pulse and ends at the time when the timing packet is sent. Each 
frame sync pulse resets the count of counter 1 3 to zero. The count stops on receipt of a signal 
from the timing packet generator that the count has been loaded into the packet. Thus count 

20 5t f represents the time interval between the time of launch of the timing packet onto the 
network and the most recent preceding sync pulse. 

The receiver 4 comprises a network interface 17 corresponding to interface 15, and 
an interface 18 corresponding to the interface 16, which feeds video packets to a video 
processor 22 and timing packets to a time packet selector 20. The selector 20 extracts the 

25 timing data from the timing packet and also supplies a sampling signal indicating the time at 
which the packet was received by the selector 20. The timing data and sampling signal are 
supplied to a Frequency Locked Loop (FLL) which includes, and controls, a local clock 30. 
The FLL is a sample data control system. Details of the clocking of samples through the FLL 
are omitted because such details are not of relevance to the understanding of the present 

30 invention and are within the normal skill of FLL designers. 

The video processor 22 requires the local clock 30 to operate at the same frequency 
27 MHz as the reference clock 10 to correctly process the video. As shown in Figures 1 and 
4, the FLL comprises a counter 32 identical to counter 1 and which counts the ticks of the 
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of the packets switched by it. Thus D may change for instance due to a change in the size of 
the time packets, which results in a change in the processing delay in the network. If D 
changes, then stays at its new value, the change affects the difference of the first and second 
differences only once at the time it changes. 
5 The foregoing discussion also ignores network jitter 5t which affects the timing of 

reception of the timing packets at the receiver, and thus affects the corresponding local 
counts L. The jitter 5t causes a variation in the differences in the times of arrival of the 
packets at the decoder 4.The jitter 8t is regarded as noise. The FLL as shown in Figure 4 
includes a Low Pass Filter 34 which low pass filters the error produced by the clock 

1 0 difference stage 26 to reduce the jitter. The filter is for example an N tap digital filter. 

The filter 34 is followed by an accumulator 36. An example of the accumulator is 
shown in Figure 6 which is described in more detail below. The accumulator continuously 
accumulates the low pass filtered error. The accumulator is needed to ensure that once 
frequency lock occurs and thus the error is zero, then the local clock which is a voltage 

15 controlled oscillator 30 has a stable, non-zero control value applied to it to prevent 
"hunting". By way of explanation assume that the local clock operates at 27MHz + X Hertz 
with zero control input. In the absence of the accumulator, when lock is achieved at 27MHz, 
. then the error and thus the control input is zero so the clock tends to drift towards operating 
at 27MHz +X. By providing the accumulator, the accumulated error signal forces the clock 

20 to operate at frequency lock and when that is achieved the error into the accumulator 
becomes zero and thus the accumulated value stays constant but non-zero. 

The accumulator is followed by a divider 38 which reduces the sensitivity of the 
clock to small fluctuations (e.g. due to noise) at the output of the accumulator. 

The divider 38 is followed by a digital to analogue converter 40 for producing an 

25 analogue control value for the voltage controlled oscillator 30. The converter is preferably a 
single bit converter followed by an RC stage 42 to remove high order harmonics produced 
by the converter. 

The filters 34 and 42, the accumulator 36 and the divider 38 together define the time 
constant and loop gain of the FLL. The time constant defines the time taken by the FLL to 
30 achieve lock. To minimise that time, it is preferable to use the known technique of varying 
the Low Pass filter 34 and the loop divider 38 to firstly achieve fast but coarse lock and then 
fine but slower lock. 
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forms the difference of the first and second differences. The output of the subtractor 56 is the 
error which controls the local clock 30. 
Accumulator 36, Figure 6 

The illustrative accumulator of Figure 6 comprises an adder 58 and a store 60. The 
adder adds the value of the current error (as processed by the filter 34) to the content of the 
store 60. The store contains the cumulative error shown in Figure 2. 

Preferably (and practically) the maximum value storable in the accumulator 36 is 
limited but the limit is placed outside the normal operating range of the FLL. 

1 Bit D to A converter 40, Figure 4 

This may be a simple pulse width modulator or a random dither module. A random 
dither module requires a shorter RC time constant (42) when operating at the centre of its 
range. 

Frame Synchronisation at the destination. 

At the destination 4, a local frame sync circuit 23 produces local frame sync pulses 
by counting the local clock ticks which as described above are frequency synchronised with 
the reference clock 1 0. The frame sync generator 23 is a counter which is reset to zero on the 
production of each frame sync pulse identically to frame sync pulse generator 11. A 
difference circuit 19 calculates the difference X between the count 5t f derived from the frame 
timing data of the timing packet of Figure 3, 8 or 9 and the count of the frame sync 
generator at the time of reception of the timing packet as indicated by the sampling pulse S. 
That difference X is used by a phase adjuster 21 to synchronise the frame sync generator 23 
with the frame sync generator 10 on the assumption that the delay applied by the network to 
the timing packets is zero or is substantially the same across all recipients of those packets. 

Referring to Figure 10, line A shows diagrammatically the count of the reference 
frame sync pulse generator 10 and of the second counter 13. The count 5tf is shown in line B 5 
which is the count of counter 13 at the time of production of the timing packet of Figure 3 5 8 
or 9. Assuming zero delay through the network, the local frame sync pulses might for 
example be produced at times shown in line C out of phase with the reference frame sync 
pulses of line A. The count in the counter 23 of the local frame sync pulse generator 23 
when the timing packet is received is shown at 'packet timing c in the line C. The correct 
reference phase of the frame sync pulses is 5tf before that as shown in line D. That is a count 
of X= 8tf- (packet timing count) before the actual timing of the local sync pulse. 
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PAL, and other details . The RTP header includes a sequence number which allows a 
sequence of packets to be reassembled in the correct order and preferably also a scan line 
number for each packet ( See Reference 1). The RTP header allows the video data to be 
written into a frame store 184 or 185 under the control of a write/read controller 186 in the 
correct sequence to reconstruct a video frame from a sequence of packets. Thus a header 
decoder 182 decodes the header and removes it from the video data, feeds the video data to 
the frame store 184 and provides the controller 186 with data, such as the scan line number, 
required to write the video data into appropriate addresses in the frame store. 

The controller 186 initiates read out of video frames from the frame stores 184 and 
185 in synchronism with the local frame sync, with a further delay if required. 

The RTP decoder and frame store are shown as part of the demultiplexer. Instead, 
they may be part of the video processor 22. 

Video Packets 

In the first example, the video packets are transmitted across the network 6 separately 
from the timing packets. As shown in Figure 7, the video packets have the same basic 
structure as the timing packets. The packet includes data which identifies it as a video 
packet. That data may be included in one or more of the headers in known manner 

Video Processor 22, Figure 1 . 

The video processor 22 may be any video processor including, for example, a 
monitor, an editor, a special effects machine, and/or a VTR. 
Second Example 

In the first example, the timing packets are sent separately from the video packets. 
Sending timing packets separately from video packets allows timing packets to be broadcast 
so that all video processors on the network have local clocks frequency synchronised with 
the reference clock, and frame synchronisers in frequency synchronism with the reference 
frame sync but also allows video to be sent point to point. 

Referring to Figure 8, the timestamp data and the frame timing data and the video 
data may be combined in one packet with common (broadcast) address data. The packet 
includes headers as described with reference to Figure 3 or 7. The packet includes data 
which identifies it as a combined time and video packet. That data may be included in one or 
more of the headers in known manner. The time stamp data field which contains a small 
amount of data precedes the video data field which contains a much greater amount of data. 
A video sequence is transmitted using many packets. The time data may be included in only 
some, but not all, of the packets. The time data may be included in a video packet at 
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reference frame sync operate independently of any data source. A data source then requires a 
local clock which is frequency synchronised with the reference clock as described herein and 
frame syncs which are synchronised with reference frame syncs. 

Whilst the foregoing describes an example of the invention in relation to an Ethernet 
network, it may be used in any asynchronous switched network. The network 6 may be a 
wired or wireless network or a combination of both wired and wireless. 

The transmitter 2 and the receiver 4 may be implemented as hardware. They may 
alternatively be implemented by software in a suitable data processor or as a mixture of 
software and hardware. A preferred implementation uses programmable gate arrays. It is 
envisaged that the present invention includes a computer program which when run on a 
suitable data processor implements the invention. 

It will be appreciated that the embodiment of the present invention described above 
are concerned with frequency synchronisation of clocks. Phase synchronisation of clocks is a 
different issue which is not addressed by the embodiments although they may be used in. 
conjunction with a phase synchroniser. 

References 

1. RTP payload format for BT.656 Video encoding, D Tynan (Claddagh films) 
RPC2431, Oct. 1998. 
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, • , in which the controlling step comprises adjusting the 
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the reference processor sending to the local processo 
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4. A method according to claim 3, in which the function is the average of the 
differences. 

5. A method according to any one of the preceding claims, comprising the step of 
adding a delay to the local image synchronisation signal. 

6. A method according to claim 5, in which the delay is a predetermined delay. 

7. A method according to any one of the preceding claims, in which the reference data 
processor comprises a source of video data produced synchronously with the reference 
processor's clock, the method comprising: 

the reference processor sending to the local data processor, via the network, data 
packets containing the video data, the timing packets being sent independently of the data 
packets. 

8. A method according to any one of claims 1 to 6, in which the reference data 
processor comprises a source of video data produced synchronously with the reference 
processor's clock, the method comprising: 

the reference processor sending to the local data processor, via the network, data 
packets containing the video data, and the reference image synchronisation data. 

9. A method according to claim any one of the preceding claims, comprising the step 
of: 

the reference processor sensing when the network has capacity to send a timing 
packet; and 

the reference processor sending a timing packet when such network capacity exists. 

10. A method according to any one of the preceding claims, in which the step of 
frequency synchronising the local and reference clocks comprises the steps of: 

the reference processor sending to the local data processor, via the network, clock 
timing packets each providing the destination address of the local processor and reference 
clock data indicating the time at which the clock timing packet is sent; and 

the local processor controlling the frequency of the local processor's clock in 
dependence on the reference clock data and the times of arrival of the clock timing packets. 
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the local processor aligning an image of a video signal with the local image 
synchronisation signal. 

19. A method according to any one of the preceding claims, in which the image 
5 synchronisation signal is a field or frame synchronisation signal. 

20. A video network comprising: 

a reference video data processor having a reference image synchronisation signal 
generator and a reference clock generator, the reference synchronisation signal generator 
10 generating periodic image synchronisation signals in synchronism with the reference clock; 

a local video data processor having a local image synchronisation signal generator 
and a local clock generator frequency-locked to the reference clock generator, the local 
synchronisation signal generator generating periodic image synchronisation signals in 
synchronism with the local clock; 
1 5 an asynchronous packet-based network linking the local processor and the reference 

processor; 

the reference video data processor comprising means for sending, via the network, to 
the local data processor an image timing packet providing reference image synchronisation 
data indicating the difference in timing, measured with respect to the reference processor's 
20 clock, between the time at which the image timing packet is launched onto the network and 
the time of production of the immediately preceding reference image synchronisation signal; 
and 

the local processor comprising means for controlling the timing of the production of 
the local image synchronisation signal in dependence on the reference image synchronisation 
25 data and the time of arrival of the timing packet. 

21. A local video data processor having a local image synchronisation signal generator 
and a local clock generator frequency-lockable to a reference clock generator at a reference 
video data processor connectable to the local processor via an asynchronous packet-based 

30 network, the local synchronisation signal generator generating periodic image 
synchronisation signals in synchronism with the local clock; 

the local processor comprising means for controlling the timing of the production of. 
the local image synchronisation signal in dependence on reference image synchronisation 
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of such a timing packet. 
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g eneratmg periodic tmage sy— a«r» s ^ n ^ ^ „ , 

te reference process™ heing connect h.e, - ^ gmerator md a ,oca, 

local video data processor havmg a local, ma ^ generator> the .oca, 

d - genera,or .srsr^i. — sienals ro 

10 synchronisation signal generator g 

svlK hron,sm wi,h .he loca! Co* ^ ^ ^ vja , he 

,he reference vtdeo data processor P synchrom sa.ron 
to local dara processor an image ummg packet reference processo ,s 

aara indicaung dre difference in during, me.med ^ ^ _ ^ „ etwork ffld 

te time of production of the mrmedtately precedtng 
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wW ch nodes is conp.ed a data processor accordrg to clatm 

accompanying drawings, 
the accompanying drawings. 

2 , A « data processor — * * heremhefore desorthed with reference to one 
accompanying drawings. 

30 „, for use in an asynchronous switched packet network in 

27 . A reference timing packet for » » ^ , he packet 

which packets of vtdeo data are -m ^ ^ 

sains— ■ 
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time at which the packet is launched onto the network and the time of production of an 
immediately preceding reference image synchronisation signal. 

28. A reference timing packet substantially as hereinbefore described with reference to 
the accompanying drawings. 
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